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Abstract 

This paper shows how the theory of dynamic risk measures pro- 
vides viscosity solutions to a family of second-order parabolic partial 
differential equations, even in the degenerate case. 

First, motivated by the martingale problem approach of Stroock 
and Varadhan, we make use of the time consistency characterization 
for dynamic risk measures, to construct time consistent convex Markov 
processes. This is done in a general setting in which compacity argu- 
ments cannot be used, and for which there does not always exist an 
optimal control. Second, we prove that these processes lead to viscos- 
ity solutions for semi linear second-order partial differential equations 
with convex generator. 

Finally we give an application to mathematical finance. We show 
that our results allow for the construction of a No Arbitrage Pricing 
Procedure in the context of stochastic volatility. Within this approach, 
convexity takes into account liquidy risk. 

Keywords: Time consistency, Convex duality, Second order par- 
tial differential equations, Feller property 



1 Introduction 

Under regularity assumptions the value function associated to an optimal 
problem for a non degenerate controlled diffusion is the classical solution 
of a second-order parabolic partial differential equation of Hamilton-Jacobi- 
Bellman (HJB) type. In the degenerate case the HJB equation does not 
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have a classical solution. Lions introduced the notion of viscosity solu- 
tion, and established the link between viscosity solutions of second-order 
parabolic partial differential equations and stochastic optimal control prob- 
lems [IHlQjj]. We refer to the paper of Crandall et al. [H] and to the book of 
Fleming and Soner [13] for results and references. Another approach making 
use of Backward Stochastic Differential Equations has been introduced by 
Pardoux and Peng [20]. Recent papers in this direction by Briand and Hu 
[6], Lio and Ley [8], Delbaen et al [10] and Richou [23] focuse on the case 
of convex generators or extend results to unbounded terminal conditions. 
Usually controlled diffusion is considered from the point of view of stochas- 
tic differential equations. An alternative approach has been introduced by 
Strook and Varadhan |24|, I25j . It consists in the construction, given s in M + 
and x in M n , of a probability measure P s>x on the set of continuous paths 
C([0, oof, M n ) solution to a martingale problem associated to the diffusion. 
Starting from the stochastic differential equations approach with controls 
taking values in a compact subset of M n , El Karoui et al [12] use the mar- 
tingale problem approach to prove the existence of an optimal control. 
On the other hand, the theory of dynamic risk measures on a filtered proba- 
bility space has been developped in recent years. In the case of a Brownian 
filtration, dynamic risk measures coincide with ^-expectations introduced 
by Peng |21] , An important property for dynamic risk measures is time con- 
sistency. The time consistency property for dynamic risk measures is the 
analogue of the Dynamic Programming Principle. For sublinear dynamic 
risk measures time consistency has been characterized by Delbaen [9J. For 
general convex dynamic risk measures two different characterizations of time 
consistency have been given. One by Cheridito et al [7], the other by Bion- 
Nadal [2j. This last characterization of time consistency is very usefull in 
order to construct time consistent dynamic procedures. 
The main goals of the present paper are twofold. First, motivated by the 
martingale problem approach of Stroock and Varadhan |24t 125] . we make 
use of the time consistency characterization proved in [2J , to construct time 
consistent convex Markov processes. Second, we prove that these processes 
lead to viscosity solutions for semi linear second order partial differential 
equations of the type 



d u v(u, x) + j0v(u, x) + f(t, x, a*(u, x)Dv(u, x)) 

v(t, x) 



on [0,t[xM 
h(x) 



(1) 
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where 

Cv(t, x) = -Tr(aa*(t, x)D 2 (v)(t, x)) (2) 

and / : M + x M n x M d -)■ M is a Borel-measurable function such that 
f(t,x,.) is a proper convex function. Here (and in all this paper) a is a 
given continuous bounded function with values in M n {M) such that, for all 
(t,x), the matrix a(t,x)a*(t,x) is definite positive. These results do not 
require uniform ellipticity, that is they even apply in the degenerate case. 
In addition to these goals, we give an application to mathematical finance. 

More precisely, the content of the paper is the following. For all given r 
in M + and y in lR n , we construct a whole time consistent dynamic proce- 
dure. For this we need a stable set of equivalent probability measures and 
a local penalty satisfying the cocycle condition [2]. We start with a family 
of probability measures on the set of continuous paths which are solutions 
to a martingale problem starting from y at time r. For every probability 
measure in this family, the canonical process (Xt) r <t is a Feller process. We 
then enlarge this set of probability measures in order to obtain a stable set. 
Given a multivalued Borel mapping A we construct in Section [2] such a sta- 
ble set of probability measures (Qr,y)s(A) indexed by a set of progressively 
measurable processes fi(s,uj) such that h(s,uj) belongs to A(s, X s (ui)). This 
set of probability measures can be considered as a set of controls. 
The construction of a time consistent dynamic procedure also relies on the 
construction of penalties associated to every probability measure in the sta- 
ble set. For this we define penalties of the shape that we have considered 
in previous papers |2] and [3]. This construction is generic in the sense that 
every normalized time consistent dynamic risk measure on a Brownian fil- 
tration is a limit of procedures for which the penalties are of this shape . 
The penalty associated to the probability measure (Pr,y) is 

t 

a s,t( p r,y) = E P% V ( J 9(u,X u (uj),n(u,Lj))du\B r s ) 

s 

Given (r, y) we construct this way (Section [3]) a time consistent convex dy- 
namic procedure defined for all J~t measurable variable essentially bounded 
from below Y by 

n™Q0 = esssup p , ye(6rj)s(A) (EpM y (Y|e s r ) - a s , t (P^ y )) 

Notice that for given (r,y), in contrast with standard control theory, we do 
not construct a single value v(r,y), but a whole time consistent dynamic 
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procedure (n^'|). 

Remark that the canonical process X% is not a Feller process for every prob- 
ability measure in the stable set (Qr y )s (A). However making use of the 
Feller property for the probability measures generating this stable set, we 
are able to prove that our time consistent procedures have the following 
Feller property (Section H|): For all Borelian map h on JR n bounded from 
below, there is a lower semi-continuous function h on [0, t[xM n such that 

Vs G [0,t[, Vx G M n , n s s '*(h(X t )) = h(s,x) 

V0<r<s<i, U r ; y t (h(X t )) = h(s,X s ) 

In case where h is continuous bounded from below, the map h extended by 
h(t,x) = h(x) is lower semi-continuous on [0,t] x M n . 

This result is proved under the " weak" hypothesis that the restriction of 
g to A is a Caratheodory function with polynomial growth. Let / be the 
conjugate of g on A, i.e. 

f(u,x,z)= sup (z*X — g(u, x, A)) 

XeA(u,x) 

Assuming that h is continuous, bounded from below and that the restric- 
tion of g to A is semi-continuous we prove (Section 15 . 3|) that the lower 
semi-continuous function h is a viscosity supersolution of (1). This result 
is a consequence of the time consistency property which is the analogue of 
the dynamic programming principle. Notice that in the usual control theory 
the dynamic programming principle is proved making use of the existence 
of an optimal control. Here we make use of a sufficient condition for time 
consistency that we proved in [2]. This provides a wide class of procedures 
which are time consistent by construction, and thus a wide class of equations 
of type (1) for which we get an explicit viscosity supersolution. 
Assuming furthermore a linear growth condition on A and a continuity hy- 
pothesis on /, we prove that the function h is a viscosity solution of (1) if 
it is continuous (Section 15. 5p . A sufficient condition for the continuity of h 
is that (1) satisfies a comparison principle. 

It is important to notice that all the results of the present paper are in 
the setting of a control set which depends on (t,X t (uj)) and which is not 
bounded. The constructed stable set of probability measures is not nec- 
essarily compact for the weak topology. Therefore, compacity arguments 
cannot be used, and there does not always exist an optimal control. 
Finally, in Section [6] we also provide an application to mathematical finance 
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which illustrates the two main points of this paper. We show that the intro- 
duction of the multivalued Borel mapping allows for a construction of a No 
Arbitrage Pricing Procedure in the context of stochastic volatility. In this 
approach, convexity takes into account liquidy risk. 

2 Time consistent sublinear procedures in Marko- 
vian framework 

The aim of this section is to use the recent results on time consistent dy- 
namic procedures to construct sublinear Feller processes. Recall that in 
[21 [3] , we have already constructed examples of both sublinear and convex 
time consistent dynamic procedures. However the processes constructed in 
these papers do not have any Markov property. Here we will make use of 
probability measures solution to a martingale problem and of the character- 
ization of the time consistency property for dynamic risk measures proved 
in [2] , to provide families of time consistent sublinear (convex in Section [3]) 
procedures with a Markov, even Feller, property. 

2.1 The martingale problem 

Let f2 (resp. £l r , be the set of continuous functions ip defined on 
(resp. [r, oof , [r, t}) with values in M n . Recall that f2, Q r and fi£ en- 
dowed with the topology of uniform convergence on compacts subsets of 
M + are Polish spaces, that is complete separable metrizable spaces. Denote 
(X t ) teSi + the coordinate process. For given r, for r < s < t, denote Bf 
(resp. B s ) the u-algebra on Q r generated by the functions X u s < u < t 
(resp. the functions X u s < u). The notation Y* denotes the transpose of 
Y. Recall the following results from |24l I25j . 

Assume that a : M + x M n — > M n (M) is continuous bounded strictly elliptic 
(i.e. positive definite at each point). It is proved in [23], Theorem 4.2 and 
Theorem 5.6 that for every (s,xo) E M + x M n , there is a unique probability 
measure Qs tXo on (Q S ,B S ) such that 

1 /■* 

Xg(t) = exp{0*(X(t) - x ) - - / 0*a(u,X(u))6du} (3) 

is a (Qs XQ , (Bf)t> s ) martingale for all 6 in lR n , and such that Q1^ Xo {X s = 
xq} = 1. Furthermore the process (Xt)t>s 1S then a strong Feller process 
for (Qg , (Bf)t> s )- Following [23], one says that the probability measure 
Qs X0 is the unique solution to the martingale problem (|3|) starting from xq 
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at time s. 

Let cr be a continuous bounded map a : M + x M n —> M n (JR) such that 
for all (t, x), a(t,x) = a(t,x)a*(t,x). Let A be a borelian bounded map 
A : M + x M n — > M n . From Theorem 6.2 of [24] there is a unique probability 
measure Qs]x on (Q S ,B S ) solution to the martingale problem: 

exp{(8)*(X(t) -x Q ) -J 6*{aX){u,X(u))du-^ J 6*a(u, X(u))9du} (4) 

starting from xo at time s, i.e. such that Qs',x {{X s = xq}) = 1. For all 

8<t, 

= ex P ( !\\*a- l )){u,X u )dX u - \ f \\* X)(u,X u )du) (5) 

the stochastic integral being computed with respect to Qs yXo ■ From [25] The- 
orem 7.1, the process (X t )t> s is then a strong Feller process for {Q^ xo , (Bf)t> s ) 
Notice that assuming a continuous bounded strictly elliptic the non nega- 
tive square root of a, a a = a? is always continuous bounded and satisfies 
cr a a* = a. However we do not want to restrict to this specific choice for a. 
In particular the financial application (Section [6]) corresponds to a matrix a 
which is not symetric. 

Notation 2.1 Given u) in Vt r , given < r < s denote 7r r,s the continuous 
projection from £l r onto £l s : 

n r > s (u;'){u)=uj'(u),Vs<u (6) 

For all probability measure Q on (Q r ,B r ), Q(tt t ' s )~ 1 denotes the probability 
measure on (Q S ,B S ) image of Q by ir r ' s . 

Recall from [24], Theorem 2.1, that given r < s, every probability measure 
on (Q,B r ) admits a regular conditional probability distribution given B r s . 

Lemma 2.2 Let a be continuous bounded and a = aa* strictly elliptic. Let 
X be borelian bounded. Let (Qr'xo) be the unique probability measure solution 
to the martingale problem starting from xq at time r (equation §4ty). Given 
s > r, let {Qr',x(s) s ,u) be a regular conditional probability of Qr]x given B r s . 
There is a Qr',x -null set N such that {Qr]x Q ) s ,u){' Kr,s )~ l = Q°,' x for all uj 
in N c . 

In particular for all Borelian map f on M k and all s < t\ < ... < t^, 

(Q^ )sAf(X tl ,...,X tk ) = Qf Xs(u) {f(X tl ,...,X tk ), G N c (7) 
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It follows from the definition of a regular conditional probability that 
(Q^o)s, w (vr r ' s )~ 1 )({a;' \X a (u) = X s (oj')}) = 1. Notice also that from the 
definition of tt t,s for all Borelian function / on M k and all s < t\ < ... < 
t k , (Q^ A ) S)U ,(7r^)- 1 )(/(X tl ,...,X t J = (Q^ ) s>w (f(X h ,...,X tk ). It follows 
then from Theorem 3.1 of |24j . that there is a set N such that Qr',x {N) = 
and such that for all uj G N c , (Qr',x )s,Lj('K r ' s )~ 1 solves the martingale 
problem Q starting from X s (lj) at time s. By unicity of the solution to 
this martingale problem, it follows that 

Vu, G N c , (Q^k^T 1 = Q^ sH (8) 

□ 

2.2 Estimates of the moments of X t 

Proposition 2.3 For a// </ > 1, A, B, and t > 0, £/iere is K > suc/i i/iat 
for all y such that \\y\\ < C and a continuous bounded such that 

^9 G M n , < 9*a9 < A\\8\\ 2 , with a = aa* (9) 

for \ \a\\ \ < B, for all <r < s < t, 

E Q ^( sup (\\X t -X u \\ 2 o)<K{t-sn\\y\\ 2 o + l) (10) 

Wr ' y s<u<t 

In the following \ \a\ \ < A means that a satisfies (0J). 
Proof 

• Assume that a is uniformly elliptic and satisfies ([9]). Denote a 2 the 
non negative square root of a. From Corollary 3.2 of |24j . there is a 
Brownian motion /3 with respect to Qr]y such that 

X t = y+ f a^{u } X u )dl3{u)+ f a\(u,X u )du (11) 

J r J r 

From [T7], II 5 Corollary 10, there is a constant K > depending only 
onij A5 and £ such that equation (j 1 U j) is satisfied. 

• For general a satisfying ([9]), Let b = a\. Notice that given r and 
y, Qr', y depends only on a = a a* and b = aX. Let R a,h = Q%\ x ■ 
Consider a,j continuous uniformly elliptic such that the sequence Oj is 
uniformly bounded by A and uniformly convergent to a on compact 
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spaces. From Theorem 9.2 of |25j applied for given b, r and y, R a j ,b 
converges weakly to R a,b as j — > oo. Given r < s < t, consider a 
sequence T n of subdivisions of [s,t] whose step tends to as n — > oo. 
For all m £ IN*, inf (sup Mg7 ^ (| \X t — X u \ \ 2q , m)) is a continuous bounded 
function. Passing to the limit as j —> oo, we obtain that for all m > 0, 

E „, x (mf(sup(\\X t - X u \\ 2 \m)) < K(t - sf(\\y\\ 2q + 1) 

Using the monotone convergence theorem, we obtain that (|10p is sat- 
isfied for all a continuous bounded satisfying Q and ||<tA|| < B. 

□ 

Corollary 2.4 Let m > 1. Let e > 0. There is ko depending only on m 
A,B,C and t such that for all k > ko, for all a continuous bounded such 
that aa* satisfies |2|), for ||<tA|| < B, \\y\ \ < C ,and r < s <t, 

E Q% A sup {\\X U - y|ri{Bup P<t ,< t [[Jr u -v||>fc}) < e (12) 

r<u<t 

Proof From Proposition 12.31 for all k > 0, 

kE Q%^ SU P (H X «-l/ir i {BUPr<u<tll^t.-y||>fc}) ^ 
'* r<u<t 

< E ^( sup (\\X U - y\\ m+1 ) < K(t - r)^(C m+1 + 1) (13) 

^ r ' v r<u<t 

□ 

Proposition 2.5 1. Let A,K,B > 0. Given r in M + , the set of proba- 
bility measures {Qr',y, \\a\\ < A, ||y|| < K, \\\<t\\\ < B} on (Q r ,B r ) is 
weakly relatively compact. 

2. For given r in M + , the map x — > Qr]x is continuous for the weak 
topology. 

Proof 

1. It follows from equation (jlpp that for q > 1, there is a constant K\ > 
such that for ||a|| < A, \\y\ \ < K, \\\<rX\\ < B, 

E Q ^{ sup (\\X t - X u \\ 2 i) < K^t - sf (14) 

s<u<t 

From theorem 2.3 of [24] , the set of probability measures {Qr]y , 1 1 a\ | < 
||y|| < K, \ \o~\\\ < B, } is thus weakly relatively compact. 
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2. Let x n be a sequence with limit x. The set {Qr',x n , n 6 IV} is weakly 
relatively compact. Any limit point of the family Qr'x„ solves the 
martingale problem for (a, A) starting from (r,x). By unicity of the 
solution of the martingale problem it follows that Qr]x n — > Q a T \ weakly. 

□ 

2.3 Feller processes with continuous paths 

Proposition 2.6 Let a be continuous bounded and a = era* strictly elliptic. 
Let A be borelian bounded. Let t > 0. For given <p Borelian bounded, there is 
a continuous bounded function U" ,X {4>) : (s,x) 6 [0,t[xM n — > U^' X ((f>)(s,x) 
such that: 

For all r < s < t and xq in M n , there is a (Qr' X )-null set N such that for 
all uj in N°, E n<J ,\ (4>(X t )\Bl)(oj) = U7 ,X (4>)(s,X s (uj)). For given a and X, 

the modulus of continuity of U^ ,X (4>) at a point (s,x) with s < t depends 
only on the uniform bound of (f>. 

Proof From [25] Theorem 7.1, given s < t, for every (ft borelian bounded on 
M n , there is a function U t ' {4>) such that for all x in R n , E n a,\{4>{Xt)) = 

W s,x 

U^ ,X (cf))(s,x). The map (s,x) 6 [0,t[xM n — > U^ ,X (4>)(x) is continuous 
bounded and for given a and A, the modulus of continuity of U^' (</>) at 
a point (s, x) with s < t depends only on the uniform bound on (p. 
It follows then from Lemma 12.21 that for every r < s < t, for all u) in N c , 

E ^ (^(X t )\B r s )(u) = U?' x ms,X s (u)) □ 

Proposition 2.7 Let a be continuous bounded and a = a a* strictly elliptic. 
Let A be borelian bounded. 

1. For all sequence s n < s with limit s, the sequence Q'^' X ,x n ('^ Sn ' s )~ 1 
admits the limit Q s ',x f or the weak topology. 

2. For f continuous bounded on M n , the map U^ ,X (f)(s,x), already de- 
fined in Proposition \2.6\ on [0,t[xM n , has a continuous extension to 
[0,t] x M n such that for all x, U^ X {f){t,x) = f(x). 

Proof 

1. The proof is similar to that of Proposition 12.51 
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2. Let / be continuous bounded on M n . Let t > 0. The map uj — > 
f(Xt(uSj) is continuous bounded. Thus from the weak convergence 
proved in 1., it follows that for all sequence (s n ,x n ) G [0,t[xM n , with 
limit (s,x), the sequence E Qa \ {f{X t ) has the limit f{x). The result 
follows then from Proposition 12,61 □ 

2.4 Stable set of probability measures in Markovian setting 

From now on cr(t,x) is a given continuous bounded function, o = go* is 
strictly elliptic. Uniform ellipticity is not assumed. For given r > and 
y in M n , we will consider probability measures all equivalent to the prob- 
ability measure Q^ y . Recall that from [2] the main ingredient in order to 
construct a sublinear dynamic procedure time consistent for deterministic 
times in L°°(Q, B r , Qr, y ) is a set of equivalent probability measures stable by 
composition and stable by bifurcation (cf [2 J definition 4.1) The definition is 
recalled in the appendix ( definition 17. 3p . Notice that a more constraining 
condition is the m-stability introduced by Delbaen [9]. It corresponds to 
time consistency for stopping times. 

For the definition of multivalued mapping and of predictable multivalued 
mapping, we refer to [2j. We introduce now a definition for a multivalued 
Borel mapping. 

Definition 2.8 A multivalued Borel mapping A from JR+ x M n into a topo- 
logical vector space E is a map A defined on JR + x M n with values in the 
set of subsets of E such that the graph of A i.e. 

{(t,x,n)\n G A(t,x)} 

belongs to the Borel a-algebra B(M+ x M n x E), and such that 6 A(t, x), 
for all (t, x). 

It can have additional properties: 

1. A is convex if\/(t,x) G IR + x IR n , A(t,x) is a convex subset of E. 

2. A is closed if for all (t,x), A(t,x) is closed. 

Given a, given r > and y in JR n , we want to associate to a multivalued 
Borel mapping A a set Q rtV (A) of probability measures all equivalent with the 
probability measure Q^ y on £>[ such that the process (X s ) is a strong Feller 
process with respect to every probability measure in Q r2/ (A). Therefore we 
introduce the following set: 
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Definition 2.9 Let a be continuous bounded and a = aa* strictly elliptic. 
Let A be a multivalued Borel mapping from JR+ x JR n into M n . 

• Let L(A) be the set of bounded Borelian maps A : iR+ x M n — > lR n 
such that for every (t,x), X(t,x) G A(i, x). 

• For given y in M n , and r > 0, define the set of probability measures 
Gr,»(A) 

Qr,y(A) = {Qrly,X G L(A)} (15) 
Recall that for T > r, 

=exp([ T X*(t,X t )a-\t,X t )dX t -]- f ||A(t, X t )\\ 2 dt) 

(16) 

• For given y in JR n , denote also 

Qr, y (A) = {Qr',y, A continuous, A G £(A)} (17) 



In order to construct a time consistent dynamic process for deterministic 
times, we need a set of probability measures stable by composition and 
stable by bifurcation (cf [2] or the appendix, definition 17. 3p . Notice that 
the above set Q r , y {A) is not stable by bifurcation. Indeed let A and j3 
belonging to L{A). Let r < s < t. Let B be a Borelian set in M n , thus 
A = {ijj G £2 | X s (uj) G B} is B r s measurable. is not a function of 

Xt[u) for t > s. Thus in general there is no Borelian map a such that the 
process defined as X(t, X t (co))lA + P(t, X t (u}))l^c for i > s and A(i,X t (a;))) 
for £ < s can be written as a(t, X t {oj)). We need to construct a stable set 
containing Q riJ/ (A). We will define it as a subset of a certain stable set. For 
every (t,oj) G x $7, denote A(t, w) = A(t,X t (oj)). 

Definition 2.10 Let a be continuous bounded and a = aa* strictly ellip- 
tic. For every bounded process fi B r T predictable, denote P^y the probability 
measure equivalent with Q^ y , on B T T with Radon Nikodym derivative 

( ,™ )l% = exp( / n* (u,uj)a~ l (u, X u )(u)dX u (uj) - - \\fi(u, uj)\\ 2 du) 

(18) 



11 



Definition 2.11 . Let < r < T. Let fj, be a bounded process B r T - 
measurable. One says that \i takes values in A if for all r < s < T , for 
all oj, fi(s,uj) G A(s, oj). Denote Ai r ^ y {K) the set of all probability measures 
Pr,'y ' , on B T T where [i is BL predictable and takes values in A. 

Lemma 2.12 The set Ai r>y (A) is a stable set of probability measures on 
{W,B r T ). For all k > 0, 

M r ,y(A) k = {P?£ G M r ,y(A) \ \\fx\\ < k} (19) 

is also stable. 

Furthermore if the mulivalued Borel mapping A is convex, Ai r ^ y (A) and 
A4 ry (A)*' are convex. 

Proof As already noticed, for given T > r, P^ y is a probability measure 
on B r T equivalent with Q^ y . The stability by composition and bifurcation is 
easily verified. The convexity (in case A is convex) follows from the proof 
of Theorem 3 of [9]. The properties of Ai r , y {A) k result then from Lemma 4 
and Lemma 5 of [Sj. □ 



Lemma 2.13 Let < r < T. The restriction to {W ,B r T ) of Q r , y {A) 
(resp. Qr,y(A)), given by [To\) (resp (Ffy), is a set of equivalent probability 
measures on {Vt r ,B^p). There is a minimal stable set of probability mea- 
sures containing Q r> y(A) (resp. Q r> y(A)). We denote it (Q r>y )s{A) (resp. 
(Qr,y)s{&))-(Qr,y)s(A)) is a subset of (Q r ^)s(A). Every probability measure 
in (Qr,y)s(A) is equal to P^ y for a certain bounded predictable process \x A 
valued. 

Proof Every probability measure in Q r>y (A) belongs to Ai^ y {A). Further- 
more from Lemma [2.12| M^ y (A) is stable. The intersection of all stable sets 
of probability measures containing Q rjJ/ (A) is stable. It is the minimal stable 
set of probability measures containing Q r>y (A). It is a subset of Ai^ y {A). □ 
Notice that the set (Q r ,y)s(A) is not closed for the weak topology in general. 
We describe now the elements of (Q r ,y)s{A). 

Definition 2.14 Let < r < T. S^{A) (resp S£(A)) denotes the set of B r T 

measurable processes fi such that: 

There is a finite subdivision r — sq <C s\ < ... < s n — T. 

For all i G {0, 1, ...n — 1} there is a finite set Li, a finite partition (Ai^j^j. of 
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f2 into B r s . -measurable sets, and Borelian (resp. continuous) bounded maps 
Xij in L(A) such that 

\/si<u< s i+1 , Vu; G O, (i(u,u) = y~] Xjjju, X u {uS))l Aii {oj) (20) 



Proposition 2.15 GivenO <r<T, the set (Qr, y )s(A) (resp. (Q r , y )sW), 
is the set of all probability measures Pry for some process [i belonging to 



ir,y Jb\ A ^J [i^ojj. \-^,r,y 

r,y 

55, (A) (resp S^K)). 



Proof It is enough to do the proof for (Qr,j/)s(A). 

Let \i satisfying ([20]) . Notice that for all X B^ measurable, 



E Prr (X\BlJ = £ l Aiij E „, Kj (X\BD (21) 



Thus it follows by induction using the stability property (cf appendix, def- 
inition 17. 3p that every P^ y where \i satisfies (|2"U|) belongs to the stable set 
(Sr,y)s(A). On the other hand it is easy to verify that the set {P^y '■ /■* £ 
S r T (A)} is stable. □ 



Lemma 2.16 Every set Q of equivalent probability measures on B^ stable 
by composition and bifurcation for deterministic times is stable by composi- 
tion for stopping times taking a finite number of real values. 

Proof Let a be a stopping time taking a finite number of values. Thus a 
can be written a = ^a=\ S i^-Ai, where Ai is a partition of Q, r < si < S2 < 
...s n < T, Ai is B T S . measurable.. Let R and Q in Q. Denote S a the prob- 

rfQ 

ability measure in Q with Radon Nykodym derivative ^Ll = d ffi (fp)o-. 

From the stability by composition and the stability by bifurcation for deter- 
ministic times, it follows easily by iteration that S a belongs to Q. □ 



2.5 Time-consistent sublinear procedures 

Remark 2.17 Xt being a strong Feller process for the probability mea- 
sure Qry, it follows from f2Bj that the Q% tV - completed filtration is right- 
continuous. Every set of probability measures (equivalent to on B r s ) 
stable for the filtration B r s is also stable for the completed filtration. In the 
following (B r s ) r < s denotes the Q^ y completed filtration. 
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Proposition 2.18 Let < r < T. Let (Q r , y )s(A) be the stable set of 
probability measures generated by (Qr,y)(A) as in Lemma \2.13[ Let r < s < 
t <T, s and t being r '-stopping times taking a finite number of values. For 
allY in L°°(n r ,13l,Q* y ), the formula 

n^(y) = esssupp rTe(Qry)s(A) Ep rT (Y| J B s r ) (22) 

defines a dynamic process time consistent for stopping times taking a finite 
number of real values. Furthermore for given s and t, the map Tl r s ' y defined 
on L°° (Q r , B[ , Qr, y ) is sublinear monotone normalized continuous from be- 
low. 

For given < r < t and Y in L°°(fT, £>[, y ), the process (IT^(y)) r < s < t 
is a Q% y supermartingale and admits a cadlag version. 

Proof The set (Q r , y )s(^) being stable, the first part of the statement 
follows from Theorem 4.4 of [2]. 

The proof of the regularity of paths which was given in [3] Theorem 3 for 
normalized dynamic processes time consistent for stopping times can be 
extended to normalized convex (and thus to sublinear) processes which are 
time consistent for stopping times taking a finite number of real values. 

Remark 2.19 In the preceding proposition, the set (Q r ,y)s(^-) can be re- 
placed by (Q r ,y)s(-h)- The result remains true. 

Corollary 2.20 The definition ofU r s ' y (Y) can be extended to random vari- 
ables Y B\ -measurable which are only Q^ y - essentially bounded from below: 
11$ (Y) = lim^ooir^Y A n). For every such Y, U r ; y (Y) satisfies (T^j) . 
and the process (H r s ,y (Y) s ) is optional. 

Proof Let Y be immeasurable and ^-essentially bounded from below, 
Y is the increasing limit of Y n = Y A n as n tends to oo. U r s ' y (Y) is then 
defined as the increasing limit of Tl r s ' y (Y n ). As we already know that for 
given s and t, U r s ' y defined on bounded random variables by formula (]22p is 
continuous from below, the extended definition coincides with the previous 
one on essentially bounded random variables. 

From the stability property of (Q r ,y)s(A-), the set {EQ(Y n \B r s )} is a lat- 
tice upward directed. Thus H r s ' y (Y n ) is the increasing limit of a sequence 
Eq u k (Y n ) as k — > oo. It is then easy to see that Il T s ' y (Y) = sup n k Eq u k (Y) 
and to deduce that II S '+(Y) satisfies (I22p . From Proposition 12.181 for every 
n one can choose a cadlag version of the process H r s ' y (Y n ) s . Thus the map 
(s,lo) — > U r s ' y (Y n )(uj) is measurable for the optional cr-algebra. It follows 
that s —?• Tl r s ' y (Y) is an optional process. □ 
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3 Time-consistent convex procedures in Marko- 
vian framework 



In Section [2] we have constructed time consistent sublinear procedures asso- 
ciated to a stable set of probability measures in Markovian setting. In this 
Section, we want to construct time consistent convex dynamic procedures in 
Markovian settting. The map a is given continuous bounded and a = aa* 
is strictly elliptic. Uniform ellipticity is not assumed. We assume also that 
a closed convex multivalued Borel mapping A is given. We have constructed 
in Section 12.41 a stable set of probability measures which are all of the form 
Pr'y where \i is a bounded process BTp measurable taking values in A (cf 
Definition (|2.10p for the definition of Pr,y 1 )- We want now to construct fam- 
ilies of penalties a s t(Pr,y') for r < s < t < T. The penalties will depend 
not only on the Borel mapping A but also on a Borel measurable function g 
with domain A. 

Let g : M + x M n x ]R n — > M U {+00} be a Borel-measurable function such 
that for all (t,x) € M + x ]R n , A(t,x) C {y £ M n \ g(t,x,y) < 00}. 
Define / as follows: 

Vz e M d f(t,x,z) = sup (-z.X - g(t,x,X)) (23) 
\eA(t,x) 

The following lemma is straightforward: 

Lemma 3.1 For all (t,x), f(t,x, .) is a closed convex function which is the 
dual transform of the function ~g(t,x, .) where 

g~(t,x,\) = g(t,x,X) if\£A(t,x) 

= +00 else (24) 

For every (t,x) dom(g(t, x, .)) = A(t,x) 
lfg(t,x,0) = QV(t,x), f takes values in [0, 00]. 

Ifg takes values in [0, 00] and satisfies V(£,x), inf\<z^(t )X )g{t,x,\) = then 
for all (t,x), f(t,x,0) = 0. 

Notice that, since A is a closed convex multivalued Borel mapping, re- 
placing g by g, one can always assume that for all (t,x), dom(g(t,x, .) = 
{A G M d \g(t,x,X) < 00} is closed, convex and equal to A(i, x). 
In the following section we construct penalties from the above function g. 
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3.1 Penalties 

In all the following, A is a closed convex multivalued Borel mapping, and 
g : M + x M n x M n — > iRUjoo} is a Borelian map such that for all 
(i, x), domg{t, x, .) = {y, g(t, x, y) < 00} = A(i, x). 

Definition 3.2 5 /ias polynomial growth on A z/ there is C > and m G JV 

sup |^(u,x,y)|<C(l+||a;|r) (25) 

yGA(n,x) 

Definition 3.3 Assume that g is non negative or has polynomial growth on 
A. Let < r < T . For all bounded process fi A-valued with left continuous 
paths admitting right limits (cdgldd), for all r -stopping times r < s < t < T , 
taking a finite number of values define the penalty a S) t{Pr'y) as follows 

t 

a s ,t( p r%n = Epf«{ [ g{u,X u {u)^{u,uj))du\B r s ) (26) 



We have introduced in [2], definition 4.3 the definition of local property and 
of cocycle condition for the penalty. These definitions are recalled in the 
appendix (Definition 17. 4p . 

Proposition 3.4 • 1. In case g has polynomial growth on A, equa- 
tion nffi\) defines an element of L (Pfff) and of L 1 {Q^ y ) for all 
bounded fj,. 

2. In case g is non negative, equation $26\) defines a non negative 
B r s random variable. 

• The penalty defined in \20\) satisfies the cocycle condition for every 
Pr'y'- Let so, s and t be r -stopping times taking a finite number of real 
values, r < so < s < t 

VsoAPrT) = CtsoA^) + EpWMPZfWJ (27) 

• The penalty defined in $26\) is local. 

• If g(t,x, 0) = \/(t,x) G M + x M n , The probability measure Q® y = 
^Pf^y has zero penalty. 
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Proof 



• 1. Assume that the function g has polynomial growth on A with 
growth exponent m. Choose q > 1 such that mq > 2. Let p 
be the conjugate exponent of q. The process fi being bounded, 
( d( Ja )bi belongs to L p (Q^ y ). Thus from Holder inequality, 



i 



E P?: ,{ sup \\X t \\ m ) < K'E Q aJ sup \\X t \D« (28) 

s<u<t s<u<t 

It follows from Proposition 12.31 that the penalty cts,t(Pr,'x) is al- 
ways well defined and belongs to L 1 (Q^ y ) and L 1 (Pr,y l ). 

2. The case g non negative is trivial. 

• The cocycle condition (]27p follows easily from the definition (]26p . 

• We prove now that the penalty a is local. The probability measures 
Pr^y and Pr,y are equivalent to Q® tV on £>[. Let A be /^-measurable. 
Assume that VA 6 L°°(B r t ), E P ^{X\B r s )l A = E P? ^(X\B r s )l A . The 
Radon Nikodym derivatives of Pf'y and P"y on £>[ are given by equa- 
tion (fTSj) . It follows that a.s. 

1a(J H*{u,u)<t~ x (u, X u )(u)dX u (uj) - ^ J \\fi(u,u;)\\ 2 du) = 

1a(J v*(u,u)a~ 1 (u,X u )(uj)dX u (uj) - ^ j \\v{u,uj)\\ 2 du) 

fi and v being caglad processes, it follows that for almost all oj in 
A, fi(u,uj) = v(u,lj) for all s < u < t. From (|26|) it follows that 
a S! t(Pr,y l )lA = ot 8> t(Fr,y)lA.- Thus the penalty a is local. 

• The last point follows easily from the definition of the penalty. □ 



3.2 Normalized time consistent convex procedure associated 
to a multi-valued Borel mapping and a non negative 
Borel map 

Proposition 3.5 Let (Qr,y)s(A) be as in Lemma \2.13l Assume that g is 
non negative, and that for all (u, x), g(u, x, 0) = 0. Let s and t be r -stopping 
times taking a finite number of values r < s < t. The formula 

lf*(Y) = esssup PrTe( 2 rj)s(A) (Ep ?; M(Y|^) - a s , t (P r ^)) (29) 
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where a, s ^{Pr'y) is given by equation A26\) defines a normalized convex dy- 
namic process on L°°(fi, (B^) + , ) time consistent for r-stopping times 
taking a finite number of values. Furthermore for fixed s and t, the map 
n^'| defined on L°°(Q, (Bl) + ,Q^ y ) is convex monotone continuous from be- 
low. 



Proof Notice that for all bounded Y, 

-\\Y\\oo < E Q? jY\B r s ) < II™ (Y) < esssup PrTe( Q ry)s(A) Ep rT (Y| J B s r ) 

Thus for all r < s < t, ||H^'^ (^V)||oo < Halloo- The statement follows then 
from Theorem 4.4 of [2]. □ 
As in the sub linear case (cf Corollary (|2.20p we have the following extension 



Corollary 3.6 The definition of H r s '^(Y) can be extended to random vari- 
ables Y (Bl) + -measurable which are only essentially bounded from below. 
H St t{Y) = lim n _ i>00 II Sji (y A n). For every such Y , n Sit (Y) satisfies l2~9\). 

3.3 General time consistent convex procedure associated to 
a multi-valued Borel mapping and a Borel map 

In this section the function g (and thus the penalty) is not assumed to be non 
negative. We assume now that the function g(u, x, 0) is bounded from above 
on M + x M n . It follows that, given T, the penalty a S) t(Qry ) is bounded 
from above, uniformly in (s, t) such that 0<r<s<t<T. 

Proposition 3.7 Assume that A is a closed convex multivalued Borel map- 
ping. Assume that g has polynomial growth and that g(u, x, 0) is bounded 
from above. Let (Q r y)s(A) be as in Lemma \2.13X Given r < s < t, the 
formula 

n#(Y) = esssup PrT6( g ry)s(A) (E PtT (Y| J B s r ) - a fl)t (P^)) (30) 

where a St t{Pr,y') is given by equation A26\) defines a convex monotone map 
continuous from below on the set of B r t measurable variables essentially 
bounded from below with values in the set of B T S measurable variables es- 
sentially bounded from below. 

Given r and y, n™ is a convex dynamic process time consistent for stopping 
times taking a finite number of values. 
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Proof For all Y bounded from below, (Eqo. ^(Y\B r s )— a S) t(Qr, y )) is essentially 
bounded from below, thus it is the same for H^(Y). 

The result follows then from the proof of Theorem 4.4 of [2] which can be 
adapted without difficulty to the case of variable essentially bounded from 
below. □. 

4 Strong Feller property of the time consistent 
convex dynamic procedure 

The goal of this Section is to prove a Feller property for the dynamic process 
lip \ (h(Xt)). Recall that from Section [2T3l for all bounded A, r and y, the 

process X t is a Feller process with respect to the probability measure Qrly 

4.1 Feller property for the penalty associated to a Feller 
probability measure 

Definition 4.1 A real valued function f defined on M + x M n 

• is a Caratheodory function if it is Borelian and if for all t, f(t, .) is 
continuous on M n . 

• has polynomial growth on I x M n where I is a subset of M + if there 
is a constant C > and m G IN such that 

V(i, x) £ I x M n , \f(t,x)\<C(l + \\x\\ m ) (31) 

We prove a Feller property for Caratheodory functions / with polynomial 
growth. 

Proposition 4.2 Let a be continuous bounded and a = aa* strictly elliptic. 
Let A be borelian bounded. Assume that f is a real valued Caratheodory 
function with polynomial growth on [0,t] x M n . 

1. There is a real valued continuous map L(f) on [0,t] x M n such that 

E a ^( f f(u,X u )du) = L(f)(s,y) Vs G [0,t] and y G M n (32) 

W s,y f 
J S 

2. For all < r < s < t and all y G M n , there is a Q"ly-null set N such 
that for all uj G N c , 



E Q 



„a( f f(u,X u )du\B r s )(u) = L(f)(s,X s (uj)) (33) 
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Notice that for all y G Ft n L(f)(t,y) = 0. 

Proof We prove statement 1. in three steps. 

• Let < s < t and y in M n . Define L(f)(s,y) by equation (|32p . The 
function / being Borelian with polynomial growth and A bounded it 
follows from Proposition 12.31 that L(f)(s,y) is a real number. 

• We prove the continuity of L(f) at every point (s,x) for s < t. 

Let (s, x) G [0, t[xM n . Choose rj > such that s+rj < t. By hypothesis 
/ has polynomial growth., thus V(V, x') G [0, s + ??] x {y G M n , \\y\ \ < 

INI + 1}, 

E Q ^ (f C{l + \\X u \\ m )(\l {m ^ <n<tnXunm du (34) 

Notice that ||^«|| > A; implies \\X U — x'\ | > k — \ \x\ \ — 1. Let e > 0. 
It follows then from Corollary 12.41 that there is ko > such that for 
fe > k and (s',x') G [0, s + 77] x {y G 2R n , ||y|| < ||x|| + 1}, 



E q°' x ( / l/( u ' X «)l 1 {su Ps , <Il<t ||x u ||>fc}^ < e (35) 

Let / fc = sup(inf (/, fe), -&). From equation dSTJ), /(«, ^ /*.(«, X u 

implies that ||X u (o;)|| > (^ — 1)™. It follows from equation ([35]) that 
there is k\ > such that V/c > k\, V(s', a;') G [0, s+??]x{?/ G JR n , ||y|| < 

INI + i}, 

E Q »,x{! \f(u,X u )-f k (u,X u )\)du<e. (36) 

X u being a continuous function of uj and /(u, .) a continuous function 
on M n , it follows that for all k, J*^ fk( u , X u (u)))du is a continuous 
bounded function of uj. 

Let (s n ,x n ) be a sequence with limit (s,x). From Proposition (|2.7p . 
the sequence of probability measures Qs^r n (II Sn ' s ) _1 converges to Qs,'x 
for the weak topology. Thus there is N > such that for all n > N, 

\E n<T ,x (/ f kl (u, X u (ui))du - E 0< r,x( f k (u,X u (uj))du\ < e 
J s+V y ^ ,/ s+7) 

(37) 
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It follows then easily from equations f|36|) and ()3T[) that 




From Proposition ^, 3\ there is a constant K > such that Vs' < ti < t, 
and < + 1}, 



The continuity of L(f) at (s, x) follows from equations (|38|) and (f39|) 
applied with ii = s + 77 

• Continuity at (t, x). Let (s n ,x n ) be a sequence with limit (t,x). From 
equation (|39p (applied with ii = i), it follows that L(/)(s n , x n ) — >• = 
L(f)(t,x) as n — > 00. 

This proves -Z. 

Statement ^. is then a consequence of Lemma 12.21 □ 
We introduce now the corresponding hypothesis on g. 

Definition 4.3 Hypothesis H g 

1. g : 1R + x ]R n x M n M is a "Caratheodory function on A" 

More precisely, g is Borelian and for all u, the restrition of g u to 
{(x, y),y G A(u, x)} is continuous (g u (x, y) = g(u, x, y)). 

2. g has polynomial growth on A ( cf Definition HO?)) . 

Corollary 4.4 Let a be continuous bounded and a = aa* strictly elliptic. 
Let X be a bounded Caratheodory function A valued. Assume that g satisfies 
Hypothesis H g . For all t > 0, there is a continuous map (s,x) £ [0, t] x M n — > 
L^ ,X (g)(s, x) such that for all < r < s < t and all y G M n , there is a Qr',y- 
null set N such that for all u G N c , 



Proof The map f(u,x) = g{u,x,\{u,x)) satisfies the hypothesis of Propo- 
sition 14.21 This gives the existence of the function L^' X (g) satisfying the 
required conditions. 




(39) 



a st {Q°+) = E aA ( / g(u,X u ,\(u,X u ))du\B r s )(u) = L? x (g)(s, X s (u)) 



(40) 
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4.2 Feller property for the dynamic convex procedure 

Proposition 4.5 Let a be continuous bounded and a = aa* strictly elliptic. 
Let X be a bounded Caratheodory function A valued. Assume that the penalty 
is given by equation\26\) (Definition 1 3. A]) for some function g satisfying hy- 
pothesis H g ( Definition \4-3\ l- 

1. For all 4> Borelian bounded on M n , and t > 0, there is a function 
V° ,X ((j)) continuous on [0,t[x]R n , bounded on [0,t[x{x S lR n \ \\x\\ < 
K} for all K , such that 

E „x(<f>(X t )) - a st (Q^) = V t a '\<P)(s,x) (41) 

s,x 

For all r < s < t and y G M n , 

E Q ^{X t )\B r s ) - a st (Q^) = V^ms, X.) Q^a.s. (42) 

2. If '(f) is furthermore continuous on M n , V°' X (<fi) is continuous on [0,t] x 
M 1 with V^ X {<j)){t,x) = (j>(x) 

Proof 

1. The equality (|4ip follows from Proposition 12.61 and Corollary 14.41 with 

V t "'\<t>) = U?\<f>) - Ll>\g) 

Ut ,X ((f)) is continuous on [0, t[xM n and bounded on [0,t[x{x G M n \ \\x\ \ < 
K} for all K. The function L^ ,X (g) is continuous on [0,t] x M n . 
The equality (|42j) is then a consequence of Lemma 12.21 

2. The result follows from the above proof and from Proposition 12.71 □ 

Following [24J (cf Section 3) we say that a process fi is r-non-anticipating if 
for all t > r, /j,(t, oS) is immeasurable . 

Proposition 4.6 Let Pr'y be a probability measure on (S7 r ,i3^) belonging 
to (Q r ,y)s(A-). The process \x is bounded and r-non-anticipating. The prob- 
ability measure P?'y on {VL T ,Bj*) is the unique solution to the martingale 
problem 

Y t = exp{(9)*(X(t)-y)-J 9*a(u,X u (oj))fx(u,oj)du~ J 9* a(u, X u (uj))9du} 

(43) 

starting from y at time r, i.e. such that E P <y,v({X r = y}) = 1. 
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Proof We use the description of (Q r ,y)s(A) given in Proposition 12.151 It 
follows that \x is bounded and r-non-anticipating. The probability measure 
Qrly 1 ' 3 being solution to the martingale problem (|3|) for A = Ay it follows by 
induction that P°y is solution to the martingale problem (f4"3|) . 
The proof of the unicity of the solution to the martingale problem given 
in Section 6 (Theorem 6.2) of [24] in the particular case where fj,(u,oo) = 
b(u, X u {uj)) can be adapted without difficulties to the more general case 
where /U is bounded and r-non-anticipating. □ 

From proposition 12.151 and the unicity result of Proposition 14.61 we deduce 
as in Lemma 12.21 the following result 

Corollary 4.7 Let v s in Sf(A) ( cf Definition \2AJj\) . Let r < s. Let v s in 
5^(A) such that for all u > s u s (u,uj) = v s (u,oj). Let (Pr,y s ) s ,ui be a regular 
conditional distribution of Pr,y s given B r s , then 

(PrT)sA^T 1 = P%; (u) Qr,y (44) 

Theorem 4.8 Let r < t. Let /j, in 5[(A). For all h in Bb(M n ) (resp. 
Cb(]R n )), there is h continuous on ([r,t[xM n ) bounded on {x, \\x\\ < K} 
(resp. h continuous on [r,t] x ]R n and h(t,x) = h{x)) such that for all 
r < s < t there is a process v s in Sf(A) satisfying ( L/5| ) and Ujty 

Vs, y E M n , Epry (h(X t )) - a a ,t(P?g') = h(s, x) (45) 

E Prr (h(t,X t )\B r s )-a s , t (P r ^) < E p ^ e (Kt,X t )\B r s )-a s , t (P^) = h(s,X s ) 

(46) 

where v s (u,lo) = for r < u < s and z> s (n,w) = v s (u,lo) for u > s. 

Proof The proof is done in two steps. The first one is the construction 
of h given The second one is the construction of v s given \x and s. 

• First step: construction of h. 

Let r = so < si < ••• < s n = t be the subdivision associated to fi as in 
Definition EES For u e]si,s i+1 ], /u(«,w) = Y^jeh 1 A i , J (u)X i j(u, X u (uj)), 
where Ay is continuous bounded. We define h recursively on [sj, Sj+i[. 
From Proposition 14.51 for all j £ I n -i there is a map con- 
tinuous on [0,t[xlR n such that equations (jHJ and ([4*2]) are satisfied, 
let 

h(s,x)= sup V^ ,Xn - ltj (h)(s,x) Vs e [«„_i,t[ (47) 

jeln-l 
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h is continuous on [s n -i, t[x M n . 

Let i + 1 < n. Assume now that h has been defined as a continuous 
function on [sj+i, t[xiR n . Let <fo(a?) = From Proposition 

14.51 for all j G there is a map V°' Xl ' ] (<^) continuous on [0, Si+i] x iR n 
with ^'^^((^^(sj+ijx) = = h(s i+ x,x). Let 

7j(s,x) = sup V^ 1 ' 3 (4>i)(s,x) Vs e [sj,s i+ i[ (48) 

h is continuous on [sj, t[xiR n . This ends the proof of the construction 
of a continuous function h associated to \i and h. Notice that for all 
s € [si, Sj+i [, there is a partition of iR™ in Borelian sets (CsjOjeiii such 
that 

h(a,x) = Y, la SJ WVr Ay '(^)(^) (49) 

• Second step: Given s £}r,t], construction of the process v s . 

There is a unique k such that s e]s&, Sfc+i]. For s = r, let = 0. For 
i > for all it s]sj, Si+i], define 

= 2 l CsiJ (X Si (u;))A l , J (n,X u ( W )) (50) 

And for u g]s, s^+i], define 

u 8 (u,u) = ^ lc s ^{X s (uj))\ k j(u,X u (uj)) (51) 

Let z> s («, w) = for u < s. For all i > k, the restriction of v s to [sj,i] 
belongs to (A) . We still denote it v s . From the construction of v s , 
it follows recursively that for all i > k, and all y E M n : 

E P ^s(h(X t )) = h( Sl ,y) (52) 

The equality 

E p?: * s {h{X t )\B r Si ) -a Sit {P^) = h( Si ,X Si ) (53) 

is deduced from equation ([52]) using Corollary 14.71 
Endly E P ^s (h(X t ) = h(s, y) and 

Eprg. (HX t )\B r s ) - a st (P r a f ) = h(s, X s ) (54) 
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Notice that from the expression of [i and from the definition of the 
penalty it follows that 

Ep^iHXtW^) - a Sn _ lt (P r ^) = 

E l^-i,i(^n- 1 X ,An " 1 ' J '(^)(Sn-l,^„_ 1 ) (55) 

From the definition of h on [s„_i4 x ^" (equation (|47l) . it follows that 

Ep^XtW^) - a Sn _ lt (P?£) < Ksn-^X^) 

Using the precedings equations and the monotonicity of the conditional 
expectation we then prove recursively that for all r < s < t, 

E P « f {h{X t )\Bl) - a st {P?£) < h(s,X s ) 

□ 

Recall that (Q r ,y)s(A) is the stable set generated by the A continuous 
bounded A valued. 

Theorem 4.9 Let a be continuous bounded and a = aa* strictly elliptic. 
Let < r < s < t. Let y in M n . Let II S t and a St t be defined as in Section 

m 

= esssup PrTe( 2 ry)s(A) (Ep^(Y|e s r ) - a s , t (P^)) 
t 

with a s< t(Pr,'y) = Ep^(j g(u,X u (uj),fi(u,uj))du\B r s ). 

s 

Assume that g satisfies hypothesis H g . Let h be a Borelian map on M n 
bounded from below. There is a lower semi-continuous function h on [0,t[x]R 
such that 

Vs G [0,t[, Vx G M n , Il s s '*(h(X t )) = h(s,x) (56) 

V0<r<s<i, U r s ' y t (h(X t )) = h(s,X s ) Q a ry a.s. (57) 

In case where h is continuous bounded from below, the map h extended by 
h(t,x) = h(x) is lower semi- continuous on [0,t] x M n . 

Proof - Let h be Borelian bounded (resp h continuous bounded). Given fi 
in SI (A) denote h^ the continuous function on [r, t[xM n (resp on [r, t] x M n ) 
with h^(t,x) = h constructed in Theorem 14.81 satisfying equations ([43]) and 
([M]). 
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Notice that for r < s, every v in Sf(A) can be identified with the process u 
in S% (A) defined by u(u,cu) = if u < s and v(u,oj) = v{u,uS) if s < u. Let 

h(s,x) = sup h^Sjx) (58) 
M6<S°(A) 

The semi continuity properties for h follow from the continuity properties 
for every ha- From Theorem 14,81 equation (|45p . for given s, 

~h(s,x)<IL s s >*(h(X t )) = sup (E pp: (h(X t ))-a st (P^)) (59) 

ves% (A) 

Furthermore, 

sup (Ep*.v(h(X t ))-a s t(Pl'x)) < sup K(s,x) < sup h u (s, x) = h(s, x) 
v€S?(A.) ^e5 t a (A) ^e5 t °(A) 

(60) 

where the first inequality is due to equation fio]) and the second one to the 
inclusion Sf(A) C <S^(A). This proves equation (|56p . Furthermore from 
equation ([M]), for all < r < s, 

IL r s > y t (h(X t )) = sup h^s,X s ) (61) 
M e5[(A) 

Notice also that from the inclusions Sf (A) C <SJ(A) c <Sf (A), and the in- 
equalities ([59]) and (|60"j) it follows that for < r < s, 

sup hfj,(s,x) = h(s,x) (62) 
Equation (JSTJ) follows from (JBTJ) and (J52D- 

- For h Borelian bounded from below, or continuous bounded from below, 
the result follows from the equation 

U s>t (h(X t )) = sup U Stt (h n {X t )) 
new* 

with h n (x) = h(x) A n (cf Corollary 13. 6p . □ 

5 Viscosity solution of the PDE 

5.1 Continuous selector 

Recall the following definition of a continuous selector (Definition 16.57 of 
[T], where a multivalued mapping is called correspondence). 
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Definition 5.1 A selector from a multivalued mapping (ft from X into Y is 
a function s : X — > Y such that s(x) € 4>{x) for all x £ X . A continuous 
selector is a selector which is continuous. 

Recall also the following definition from [lj (Definition 16.2 and Lemma 
16.5): 

Definition 5.2 A multivalued mapping (ft from X into Y is lower hemicon- 
tinuous if it satisfies the following equivalent conditions 

• For every closed subset F of Y, (ft u {F) = {x £ X : <ft{x) C F} is closed 

• For every open subset V of Y, (ft l (V) = {x G X : (ft(x) (IF / 0} is open 

Recall also the following Michel Selection Theorem (cf [1] Theorem 16.61) 

Theorem 5.3 A lower hemicontinuous mapping from a paracompact space 
into a Banach space with non empty closed convex values admits a contin- 
uous selector. 

Recall also that every metrizable space is paracompact (Theorem 2.86 of 

ID- 

5.2 Comment on the notion of viscosity solution 

We refer to |14j for an exposition of the theory of viscosity solutions for 
second order partial diffrential equations. Consider the following PDE on 
[0,t[xM n 

H(u, x, v(u, x), d u v(u, x),Dv(u, x), D 2 v(u, x)) = (63) 
Recall the definition: 

Definition 5.4 • An upper semi- continuous function v is a subsolution 
in the viscosity sense to 163\) on [0,t[xiR n if for all (to,xo), to < t, 
and all function (ft of class Cl' 2 such that (to,xo) is a local maximizer 
of v - (ft, and v(t ,x ) = (ft(t ,x ) 

H(t , x , (ft(t , x ), d u (ft(t ,xo), D(ft(t ,x ), D 2 (ft(t , x )) < (64) 

• A lower semicontinuous function v is a supersolution in the viscosity 
sense to HM) on [0,t[xM n if for all (to,xo), to < t, and all function 

1 2 

(ft of class C b ' such that (to,xo) is a local minimizer of v — (ft, and 
v(t ,x ) = (ft(t ,x ) 

H(t , x , (ft(t , x ), d u (ft(t ,xo), D(ft(to,x ), D 2 (ft(t , x )) > (65) 
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• A continuous function v is a viscosity solution of A63\) on [0,t[x]R n if 
it is both a subsolution and a supers olution. 

In the case where the continuity of v is not known, the semicontinuous 
envelopes of v are considered: 

v*(s,x) = liminf v(s',x') (66) 

(s',x')— >(s,x) 

v*(s,x)= limsup v(s',x') (67) 

(s',x')— >{s,x) 

Assume now that we want to prove that v is a viscosity solution of (j63[) . We 
have the following result proving the continuity of v at all points as soon as 
v is continuous at terminal points, when a comparison principle is satisfied. 



Proposition 5.5 Let v : [0,t] x Wt n — > M. Let g(x) = v(t,x). Assume that 
v is continuous at (t,x) for all x 6 M n . 

Assume that t>* is a supersolution of IR>3\) in the viscosity sense on [0,t[xM n . 
Assume that v* is a subsolution of l\63\) in the viscosity sense on [0, t[xM n . 
Assume that a comparison principle is satisfied. 

Then v = v* = v*, v is continuous on [0,t] x M n and is the unique solution 
of viscosity of \63\) on [0,t[xM n with terminal condition g. 

Proof The function v being continuous at (t, x) for all x in JR n , it follows 
that v*(t,x) = v*(t,x) = v(t,x) = g(x) for all x. The function v* being a 
supersolution, v* a subsolution, it follows then from the comparison principle 
that v* < v*. 

On the other hand it follows from the definition of and v* that < v < 
v* . This proves that v* = v = v* . Thus v is continuous and is the unique 
viscosity solution of (j63|) on [0,t[xJR n with terminal condition g. □ 

Remark 5.6 If v is not continuous at (t,x) for some x v*(t,x) < v*(t,x). 
The comparaison principle does not allow to conclude. 

5.3 Viscosity supersolution 

We introduce the following hypothesis: 
Definition 5.7 Hypothesis H\: 

The multivalued Borel mapping A satisfies hypothesis H\ if A is a multival- 
ued Borel mapping convex and closed valued such that for all K large enough, 
Ak is lower hemicontinuous, where Ax{t,x) = {y £ A(t,x), \\y\\ < K}. 
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Assume that h is continuous bounded from below and that g satisfies 
hypothesis H g . Let t > 0. In Theorem 14,91 we have proved the existence of 
a lower semi continuous function v = h on [0, t] x ]R n such that 

v(s,x)=Il s >*(h(X t )) (68) 

and 

Il r s ' y t (h(X t )) = v(s, X s ) Vr<s<t Q^ y a.s. (69) 

We want to prove that v is a viscosity supersolution of a second order 
PDE. 

Let (t ,x ) G [0,t[xiR n . Let e Cj' 2 ([0,t] x JR n ) such that 

= v(t ,x ) - (f>(to,x ) = min(v(t,x) - (f>(t,x)) 

Lemma 5.8 Assume that a~ l {u,X u ) is bounded on [0, T] x $7. For all 
bounded fi such that P"'y belongs to Qr,y(A), there is a Brownian motion 
W^(u) with respect to P^y such that 

dX u {uj) = a(u,X u )(u)n(u,uj)du + a{u,X u )(uj)dW^(u){uj) P?£ a.s. (70) 



Proof From Proposition 14. 6| P^y is solution to the martingale problem 

Y t = ex P {{6)*{X(t)-y)-J 9*a(u,X u (u))p J (u,uj)du~ j 9* a(u, X u {u))9du} 

(71) 

starting from y at time r. 

Let 9 £ M n . Since the functions a and <t _1 are bounded, and the process \x 
is bounded and non anticipating, one can apply Theorem 3.2 of [24] with 

and s 

£{s){uo) = X s (uo) -y - j a(u,X u (u))fi(u,u;)du 

It follows that 

exp{ J 9*{o-- 1 ){u,uj)[dX u - a{u,X u (u))^(u,u)du}) - -\9\ 2 {t - s) 

is a Pr,y martingale. The proof follows then the proof of Theorem 3.3 of 

□ 
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Theorem 5.9 Let a be continuous bounded and a = aa* strictly elliptic. 
Assume that A satisfies hypothesis H A . Let h be continuous bounded from 
below. Assume that the restriction of g to {(u,x,y), y G A(u,x)} is upper 
semi- continuous and that g satisfies hypothesis H g . Let v be a lower semi 
continuous function such that equations HJB\) and HJ9]) are satisfied. Then v 
is a viscosity supersolution of 

( — d u v (u, x) — Cv(u, x) — f(u, x, a*(u, x)Dv(u, x)) = 

v(t,x) = h(x) 

(72) 

at each point (tQ,xo) such that f(tQ,xo,a(to,XQ)*D(p(to,xo)) < oo. Here 
f(u,x,z) = sup X€A ^ x) {z*X-g(u,x,X)), andCv(u,x) = \Tr(a{t,x)D 2 (v)(t,x)). 

Proof 

• Step 1: Time consistency 

From the time consistency property for H^f , it follows that for all 
stopping time < 5 < t — to taking a finite number of real values, 

sup (Ejf* (n^(/*(X t ))) - a t0 , t0+5 (P^ X0 )) (73) 

P t CT ,V(S* ,, ) S (A) 

Recall that v is lower semi continuous, <j) is continuous, and v(u,x) > 
4>{u, x) for all u £ [0, t] and x £ M n . From equation (j69|) it then follows 
that for every stopping time 5 taking a finite number of real values, 

K'+6,M X t)) = <to + S, X t0+S ) > 4>(t + 5, X t0+S ) (74) 

• Step 2: Ito's formula in case a -1 is bounded. 

From Lemma I5TK1 applied with fi(u,uj) = X(u, X u (oj)), there is a Brow- 
nian motion W x with respect to the probability measure Qt£ Xo sucn 
that 

dX u = {aX){u, X u )du + a(u, X u )dW x (75) 
We can now apply Ito's formula to 4>(t,Xt). 

(f>(t + 5,X to+s ) = <p(to,x ) 

rto+S 

+ / [<fi u (u,X u ) + -Trace(D 2 (p(u,X u )(a)(u,X u ))]du 

rto+5 rto+8 

+ (D<p)*(u,X u )o-(u,X u )dW*+ (D<t>)*(u,X u )a(u,X u )X(u,X u )d U (76) 

J to J to 
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It follows from equations ([73]) . ([73]) and ([76]) . that for every Qt^ xo , 

ngf (/iM)-^(*o,x )> 

iK'+IMXt)) - f ° g(u,X u ,X(u,X u )du] - <t>(t ,x ) > 

rto+S y 
E n a,\ [ (4> u (u,X u ) + -Trace(D 2 (j)(u,X u )a(u,X u ))du] 
Wt o^o Jto 2 



rto+o 

+E ' CT , A [/ (D0*(n,X u )cr(n,X u )A(u,X u ) - g{u,X u , X(u,X u ))du] 

(77) 

Thus 

rto+S j 
> -E„ ct ,a [ / (</>«( n ; -X'u) + -Trace(D 2 4>(u, X u )a(u, X u ))du 

+-E a,A [/ (D<t>*{u,X u )a{u,X u )X{u,X u ) - g(u,X u , X(u,X u ))du 

^tQ,*0 Jt 

(78) 



Step 3 General case 

We consider o n such that {o n )~ l is bounded and such that the sequence 
o n is uniformly bounded and converges to o uniformly on compact 
spaces. Prom Theorem 9.2 of [25] applied for given A, to and xq, Qt^'xo 
converges weakly to Qt^ Xo as n — >• oo. The function 
U,+S i 



u (u,X u ) + -Trace({D 2 <j))o 2 ){u,X u )) + ((D<f>)*a\)(u,X u ))du 



2 i\ 2 \ 

to 2 

being a continuous bounded function of oo, we can pass to the limit 
when n — > oo. g is not bounded but A is bounded. Using the polyno- 
mial growth hypothesis for g and the estimates of the moments of Xt 
(Proposition I2.3[) we can proceed as in the proof of Proposition 14.21 
Let gk = sup(inf (g, fc), — k). There is k > such that V7c > k, for all 
d= o n or o, 

rto+S 

E B ,x (/ \g(u,X u ,X(u,X u ))-g k (u,X u ,X(u,X u ))\)du<e (79) 

Wt 0'-0 Jto 

Thus we can also pass to the limit as o n tends to o in equation (|78|) 
even for the "g" term. This proves that inequality (|78p is satisfied for 
all o bounded such that oo* is strictly elliptic. 
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• last step: viscosity supersolution 

By hypothesis f(to, Xq, a (to, xq)* Dcfi(to, xo)) < oo. Thus for all e > 0, 
there is Ao G A(to,xo) such that 

((D(j))*a)(t , x )Xo - g(h, xo, A ) > f(t , x ,a(t , x )*D^(to,x )) - e 

(80) 

From Hypothesis (H\) for K large enough Ak is lower hemicontinuous. 
Choose such a K > ||Ao||. Let C be the multivalued Borel mapping 
defined by 

C(u,x) = A K (u,x), V(u, x) j= (to, xo) 
C(t ,x ) = {A } 

C is also lower hemicontinuous. From Theorem 15.31 there is thus a 
continuous bounded selector X(u,x) of A such that for every (u, x), 
X(u,x) G Ak(u,x) and A(to,^o) = Ao- 

From the upper semi-continuity of g on {(u,x,y), y G A(u,x)}, and 
the continuity of the maps A, X Q U ,D 2 &, and a, for all e > 0, there is 
■q > 0, such that for to < u < t < to + r] and | \xo — x\ \ < r], 

g(t,x, X(t,x)) -g(t ,x ,Xo) < e (81) 

\<p u (u,x) + -Trace(D 2 (f>(u,x)a(u,x)) + (D(f>*(u,x)a(u,x)X(u,x) — 
4>u(to, xo) + ^Trace(D 2 4>(t , x )(a)(t , x )) + Dcf)*(to,xo)a(to,xo)Xo\ < e(82) 

From Proposition 12.31 applied to the probability measure Q"'^ Xo , there 
is < a < r] such that 

Q^ X XQ (A) < e with A = {oj \ sup \\X U - xo\\ > t] } 

U)<u<to+a 

Let S = ol\a c - 5 is a stopping time taking only two values. For to <u < 
to + 5, g(u,X u (ui),X(u,X u (ui))) < g(to, xo, Xo) + e. Divide the inequal- 
ity ([78)) by a. The left hand side is equal to 0. From equations (|8T|) . 
([82]) and ([80|) . the right hand side is greater or equal to [4> u (to,xo) + 
\Trace(D 2 4>(to, x )(a)(t ,xo))+f(to, x , a(t , x )* D(p(t , x ))-3e](l- 
e). This proves that v is a viscosity supersolution of ([72]) . 

□ 
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5.4 Viscosity subsolution 

As in the previous subsection we assume that h is continuous and bounded 
from below. As in the previous Section v = h is the lower semicontinuous 
function on [0, t] x M n such that v(t,x) = h{x) and Tl s s 't(h(Xt)) = v(s,x) 
and 

U r s 'J(h{X t )) = v(s, X s ) V r<s<t (83) 

(cf Theorem H3|). 

Denote v* the upper semi continuous envelope of v, 

v*(s,x) = limsup v(s',x') 

(s',x')— >(s,x) 

Let <j) S Cl' 2 such that 

= v*(t , x ) - (f>(t , x ) = sup(t>*(s, x) - (j){s, x)) (84) 

(s,x) 

We introduce now a growth hypothesis on A. 

Definition 5.10 • The multivaled Borel mapping A has linear growth 
if there is a Borelian map such that 

VyG A(t,x), |H| <Mt,x) (85) 

and such that 4>a(s, x) < K(l + ||x||). 

• The multivaled Borel mapping A satisfies hypothesis H\ if it satisfies 
hypothesis H\ (cf Definition \5. Ity and if it has linear growth. 

Lemma 5.11 Assume that the multivaled Borel mapping A has linear growth. 
For all q > 1, A, C , and t > 0, there are constants K\ such that for all y 
such that \ \y\ \ < C and a continuous such that \\a\\ < A, and all bounded n 
such that Prjy belongs to {Q r ,y)s(k) 

E P?f { sup (\\X t - X u \\ 2 *) <K x {t- sf (86) 

s<u<t 

Proof 
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• Assume that cr _1 (u, X u ) is bounded on [0, T] x CI. Prom Lemma [5.81 for 
all bounded fi such that P°y belongs to Q rj3/ (A), there is a Brownian 
motion Wu with respect to Pr'y such that 

dX u (u) = a(u, X u )(u)n(u,u)du + a(u, X u )(uj)dW£{oj) Pff a.s. 

(87) 

Let b(s, X s (uj),uj) = a(s, X s (ui))fj,(s, uf). a being bounded by A, and \i 
being A valued, it follows from hypothesis H\ that | \b(s, X s (ui), uj)\ \ < 
AK(1 + \\X s (u)\\). It follows then from [17J, II 5 Corollary 10, that 
there exists K\ > depending only on q A B K and t such that 
equation (i86j) is satisfied. 

• For general a consider as in Theorem 15.91 a sequence a n such that 
(ffn)" 1 is bounded and such that the sequence a n is uniformly bounded 
and converges to a uniformly on compact spaces. We then conclude 
as in the proof of Proposition 12.31 

□ 

Theorem 5.12 Let a be continuous bounded and a = era* strictly elliptic. 
Assume that A has linear growth. Assume that h is continuous bounded 
from below. Assume that g satisfies hypothesis H g . Assume that f is upper 
semi continuous at (to,xo,a*(to,xo)D(f)(to,xo)). Letv = h be the lower semi 
continuous function as in Theorem \4-9\ . Then v* is a viscosity subsolution 
of 

— d u v(u, x) — Cv(u, x) — f(t, x, cr*(u, x)Dv(u, x)) = (88) 
with f(u, x, z) = swp XeA(MiX ^z*X - g(u, x, A)) 

Proof The function / being upper semi continuous at (to, o~*(to, xo)D(j)(to 
and X, $ u , Z) 2 $, D<f> and a being continuous, for all n G IN*, there is r] n > 0, 
r\ n < 1, such that for to < u < t < to + Vn and ||xo — x\\ < r) n , 

f(t,x,a*(t,x)D<t>(t,x)) < f(t ,x ,a*(to,x )D^(to,xo)) + - (89) 



\4> u (u,x) + -Trace(D 2 (j)(u, x)a(u, x)) + (D(j)*(u, x)o~(u, x)X(u, x) — 
<t>u(to,Xo) + lrTrace(D 2 4>(t , x )a(t , x )) + -D^*(t , x )o-(t , x )A | < -(90) 
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From Lemma [5.11| there is j n > such that for all \ u— to\ < 1 and | \y— xq\ \ < 
1 for all fi A valued such that P^y belongs to <2u,y(A), 

P^(A n ) < - with A n = {u)\ sup \\X U , - y\\ > ^ } 

Let <5 n = 7nlA= • is a stopping time taking only two values. 

For all n > choose (i n ,x n ) such that \t n — to I < ^T> ||^n ~~ x o|| < ^jf an d 

^(t n ,x n ) ~ v(t n ,x n ) < 

From equation ([83]) v(t n ,x n ) = Hl™'^™ (h(X t )) . On the other hand, 
DfclfW)) = 6( ^ )fl(A) (^(W) - a w (P^.J) (91) 



Thus for all n > 0, there is a bounded process /U n , i n -non-anticipating, 
PtSl G (2wJs( A ) such that 

v(t n ,x n ) < E Prn (h(X t )) - a w (i£'£ n ) + «n (92) 

From the cocycle condition for the penalty associated to the probability 
measure Pg£ n and the definition of t (/i(Jr t )), it follows from (1921) 

that 



«(tn,x„) < %,.n [IL^ t (/i(X t ))- / g(u,X u ,pi n (u,u)du]+a n (93) 



From equation ([83]) 

U^lMX t )) = v(t n + <5„,X tn+5 J (94) 



Furthermore, v < v* < <p, v being lower semi continuous, v* upper semi 
continuous and <j) continuous. It follows that 

v(t n + 5 n , X tn+Sn ) < 0(i n + S n ,X tn+Sn ) (95) 

From equations ([93]) ([94]) and ([95]), it follows that 

rtn+Sn 

v(t n ,x n ) < Ep^n [4>(t n + 5 n ,X tn+Sn ) - / g(u,X u ,fi n (u,uj)du\ + a n 

As in the proof of Theorem l5.9l we consider aj continuous, a~ l bounded such 
that the sequence dj is uniformly boundedby A and uniformly convergent 
to a on compact spaces. Proceeding as in the proof of Proposition 14.21 even 
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if g is not bounded, using the weak convergence of Pt ( j"x ( " to -P^™ when 
j — > oo, we get that for given n, there is j(n) such that 

v(t n ,x n ) < E "x n yi*n[<t>(t n + 8 n ,X tn + 5n )- j g(u,X u , n n (u,u))du] + 2a n 

(96) 

As in the the proof of Theorem 15.91 we apply Ito's formula to (j)(t n + 
8 n ,Xt n+ s n ) using the P^^'^-Brownian motion W n . Using the inequal- 
ity 

D(j)*{u,X u (^))a^ n )(u,X u (uj))iJb n {u,ijj) - g(u,X u ,fjL n (u,u;)) < 

f(u, X u (oj),a* (n) (u, X u (lo))D0(u, X u (cj)) (97) 

Letting n tend to oo, it follows from the definition of 6 n , the uniform con- 
vergence of a n to a on compact spaces and upper semicontinuity of / at 
(to,x ,a*(t ,x )D(j)(to,x )) that 

< 4> u (to,xo) + C(f)(t , x ) + f(t , xo, a(to,xo)D(J)(to, x )) 

i.e. v* is a viscosity subsolution of (I88p . 

□ 

5.5 Viscosity solution and uniqueness 

The following Theorem results from Theorems 15.91 and 15.121 

Theorem 5.13 Let a be continuous bounded and a = a a* strictly elliptic. 
Assume that g satisfies hypothesis H g . Assume that A satisfies hypothesis 
if A- Let h be continuous bounded from below. Assume that f is upper 
semi continuous and that the restriction of g to {(it, x, y), y G A(ii, x)} is 
upper semi continuous. Let v = h be the lower semi continuous function on 
[0,t] x M n as in Theorem \4-9[ Assume that the function v is continuous. 
Then v is a viscosity solution on [0,t[xM n of 

( — d u v(u,x) — Cv(u,x) — f(u,x,a*(u,x)Dv(u,x)) = 

v(t,x) = h{x) 

(98) 

where f(u,x,z) = sup AeA(u>;r) (z*X - g(u, x, A) 
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We now give two sufficient conditions for the continuity of the function 
v. The first one is the existence of an optimal probability measure. The 
following lemma is a direct application of proposition 14. 51 

Lemma 5.14 Assume that there is a probability measure Qo'y in Qo tV (A) 
such that for all s G [0, t[, 

U°;J(h(X t ) = E Ql +{f(X t )\B s ) - a s , t (Q^) (99) 

Then the function v = h as in Theorem \4-9\ is continuous. 

The following lemma gives a sufficient condition for the continuity in 
cases where an optimal control does not exist. 

Lemma 5.15 Let a be continuous bounded and a = aa* strictly elliptic. 
Assume that g satisfies hypothesis H g . Assume that A satisfies hypothesis 
H\. Let h be bounded from below and a Holder- continuous for some a > 
0. Let v = h be the lower semi continuous function on [0, t] x M n as in 
Theorem \4-9\ Assume that the PDE l\98\) satisfies the comparison principle 
for functions bounded on compact spaces. Then the function v is continuous. 
Lt is the unique viscosity solution of [98\ ). 

Proof 

• We prove first that v is continuous at (i, x) for all x and that v is 
bounded on compact sets. Recall that for all x, v(t,x) = h(x). Let 
s < t. 

\v(s,x) -h(x)\ < sup \Ep° t (h(X t ) - h(x))\ + sup \a st (P^)\ (100) 
n n 

Let m be the growth exponent of g and a > the exponent of Holder- 
continuity of h, one can choose p > 1 such that ap > 2 and mp > 2. 
From Holder inequality it follows that there is C such that 

\v(s,x) -h(x)\ < Csup([E P ^\X t -x\ ap ]p +(t-s) 

+[E Kf (J \\X u \rdu)}^) (101) 

It follows from Lemma 15.111 that \v(s,x) — h(x)\ tends to uniformly 
in x when s tends to t. Since h is continuous and h{x) = v(t,x), it 
follows that v is continuous at (t, x) for all x and also that v is bounded 
on compact sets. 
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It follows from the definition of v* that v*(t,x) = v(t,x) = h(x) for 
all x. Prom Theorem 15.91 ^ is a viscosity supersolution of (|98p . From 
Theorem I5.12| the function v* is a viscosity subsolution of (|98p . The 
function v, and thus v* , are bounded on compact spaces. It follows 
from the comparison principle that v* < v on [0, T] x M n . The converse 
inequality follows from the definition of v* , thus v = v * is continuous 
and is the unique viscosity solution of (f98|) . □ 



For comparison results for non linear second order PDE we refer to [144 [TH| 

nun]. 

We give now an application to a stochastic volatility model. 



6 Application to a Stochastic volatility Model 

In this section we consider a general framework for a stochastic volatility 
model in mathematical finance. The volatility process for the price pro- 
cess is assumed to be itself a stochastic process. The financial market is 
thus incomplete and we assume that it satisfies the no arbitrage hypothesis. 
Therefore there exists an equivalent martingale measure for the discounted 
price process St- A general framework for a stochastic volatility model writ- 
ten under an equivalent martingale measure is thus: 



dS t = <r(t, S t , Y t )( y/l - p(t, S t , Y t fdWl + p(t, S t , Y t )dW 2 ) 
dY t = a(t,S t ,Yt)dt + j{t,St,Y t )dW? 

(101) 

where W 1 and W 2 are two independent n dimensional Brownian motions. 
This framework includes the framework considered by Hull and White [15] . 
Assume that a and 7 are continuous bounded symmetric definite positive 
matrices for all (t,s,y), and that p is continuous with values in ] — 1,1[. 
Denote S the matrix associated to the above system, and a = SS*. 

a(t,St,Y t ) = 
( a 2 (t,St,Y t ) (pa 7 )(t,S t ,Y t )) \ 
V (pha(t,S t ,Y t )) (7 2 (t,St,Y t ) J [WZ) 

One can easily verify that a is continuous bounded strictly elliptic. Define 
now the multivalued Borel mapping A from M+ x M 2n into M 2n . 

A(t, s, y) = {(a, u), \ ay^l - p{t, s,y) 2 ) + up(t, s, y) = 0} (103) 
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It follows easily from the definition that for all (t, s, y), A(t, s, y) is a n dimen- 
sional vector subspace of M 2n . It is thus convex and closed. A probability 
measure PsqY * s an ec L u i va l en t martingale measures for St if and only if for 
all t and co, Ht(oj) belongs to A(t, St(uj), Y t (oj)). 

Lemma 6.1 For all K > 0, Ak is lower hemicontinuous, where Ax(t, s,y) = 
{(a, v) G A(i, s, y)\ a*a + v*v < K}. 

Proof Let (t n ,s n ,y n ) with limit (t,s,y). Let (a, u) G Ajc(t,s,y). Let 

Un = ^ V^-P^f^p . and an = _ u P(t n ,s n ,y n ) j t ig eagy tQ yerify 
V(l-p(M.iO ) y{^-p(t,s,y) 2 ) 

(a n , u n ) belongs to A(t n , s n , y n ), and that (a n , u n ) — > (a, u) as n — > oo. Fur- 
thermore a* n a n + h>*v n = a*a + v*v. Thus (a n ,u n ) G A K (t n , s n ,y n ). From 
the characterization of lower hemicontinuity given in Theorem 16.21 of [I], 
this proves the result. □ 
Given (f) real valued denote A^ the multivalued Borel mapping 

A*(t, s, y) = {(a, !/) G A(i, s, y) | a*a + !/**/ < 0(s, y)} (104) 

Lemma 6.2 Let <f>(s, y) = C(l + (s*s + /or C > and k G IV. Tften 

A^ satisfies hypothesis Ha 

Proof It is enough to prove that for all K > 0, A^- is lower hemicontinuous. 
The proof is adapted from the proof of Lemma 16. 1\ replacing v n and a n 

respectively by v n = v n inf (l, and d n = a n inf (l, yj ■ □ 

The following proposition is an application of our above results and of JTj 
Theorem 5.1. 

Proposition 6.3 • 

n O(5 ,lo)^ =esssup )(A) E p E, M (£|£ B ) 

r o,(s ,Y ) tl -^o,(So,Y );s^ 1 ; r o,(s ,Y ) 

is the surreplication price. 

• Choose for g a non negative function on ]R + x M 2n x ]R 2n such that 
g(t, (s,y), (0,0)) =0 for allt. Then 

n°s',t S (0 = esssup e, m f A v ,)^a0-)( e p s,m ^\B s )-a s>t (Pfl" S Y ) ) 

0,(S ,Y ) fc( -^0,(S ,Y );S^; 0,(S ,Y ) U,(,D0,I0; 

defines a No Free Lunch Time Consistent Convex Pricing Procedure 
extending the dynamics of the asset St- T^'[ S °' Y °\^) represents the dy- 
namic ask price for the asset £, — 11° °'*°'(— £) represents its dynamic 
bid price. 
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• The dynamic ask price IL s 'l °' (h(St)) of an european option, for h 
Borelian bounded from below is equal to h(s,X s ,Y s ) for a lower semi 
continuous function h on [0, t[xM 2n . When h is continuous and when 
the hypothesis of Theorem \5.13\ are satisfied, h is a viscosity solution 
of the second order PDE $98\). 

The choice g > non equal to allows to take into account the liquidity 
risk. As a simple example we can make the choice of a power penalty, i.e. 
g(t,s,y,a,u) = ^ a '^ P for some 1 < p < oo, if (a, u) G A^(t,s,y), and 

git, s, y, a, v) = +oo otherwise. Let ipt s y( z , z> ) = \\ z p(M,y) z n\ j^ e ^ 

q be the conjugate exponent of p. The function / is then given on iR + x 

R 2n x M 2n by fQ^y^J) = ^.yM" when ^ y ^ z >) < ^,8^)^, 

l p 

and f(t, s, y, z, z') = ipt,s,y(z, z')<&{t, s, y) a — ^^' s ^ 7 otherwise. It is easy to 
verify that g and / satisfy the hypothesis of Theorems 15. 91 and 15.121 When h 
is Holder continuous, this provides a viscosity supersolution and a viscosity 
subsolution of ([98]) . 

We can also choose the function g such that the dynamic bid price —H s ^(—hi(St i )) 
and ask price H^h^StJ) for a finite number of given options h^S^) are 
compatible with limit order books observed in the financial market for these 
options (p)]). 

7 Appendix: Time consistent dynamic procedure 

Motivated by the problematic of the evaluation of financial risks, the notion 
of risk measures has been introduced at the begining of the 21 st century. 
Here we give the definition of a time consistent dynamic risk procedure, 
which is up to a minus sign a time consistent dynamic risk measure. In the 
following T can be either the set of deterministic times or the set of stopping 
times taking a finite number of finite values or the set of all stopping times. 

Definition 7.1 A T-time consistent dynamic procedure on a filtered prob- 
ability space (fl, Too, (Ft)tem+iP) is a family (n S)t ) < s <i ) s,t in T: 
n S)t : L°°{Ft) -> L°°{F S ) satisfying 

1. For every s < t the following four properties: 

• monotonicity: ifX < Y then U S; t(X) < TL S) t(Y) 
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• translation invariance: V Z G L°°(T S ) 



U s>t (X + Z)= IL s , t (X) + Z 



• convexity: VA G [0, 1] 



n Sj *(AX + (1 - X)Y) < XIL s>t 



(X) + (1 - A)n S)t (F) 



• continuity from below: for every increasing sequence X n of ele- 
ments o/L°°(J : i) such that X = lim X n , the increasing sequence 
Jl s j(X n ) has the limit U St t(X). 

2. time consistency: For < r < s < t inT, for all X G L°°(J r 4) 



Definition 7.2 The dynamic procedure can have additional properties. 

• It is normalized if\/s<t II Si t(0) = 

• It is sublinear if 



The most important way of constructing time consistent dynamic pro- 
cesses is to construct a stable set of equivalent probability measures and to 
define on this set a penalty which is local and satisfies the cocycle condition. 
Recall the following definitions introduced in [2]. 

Definition 7.3 A set Q of equivalent probability measures is T -stable if it 
satisfies the two following properties: 

1. Stability by composition 

For all s in T, for all Q and R in Q, there is a probability measure S 
in Q such that 



Vs < t VA > o vie L°°(F t ) n 



(XX) = XU S!t {X) 





(105) 



s 



where (jp) s means E(^p\F s ) 
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2. Stability by bifurcation 

For all s in T, for all Q and R in Q, for all A 6 T s there is a 
probability measure S in Q such that for all X G L°°(Q, P), 

Es{X\F s ) = l A E Q (X\F s ) + l A cE R {X\F s ) (106) 

Delbaen introduced in [9] the notion of m-stability which is the condition 
of stability by composition for stopping times taking both finite and infinite 
values. Notice that the m-stability implies from Proposition 1 of [9] the 
stability by bifurcation. 

Recall the following definition of a penalty [3], and of the cocycle condi- 
tion 

Definition 7.4 A penalty function a defined on a T -stable set Q of proba- 
bility measures all equivalent is a family of maps (a s ,t), s < t in T, defined 
on Q with values in the set of T s -measurable maps. 

i) It is local: 

if for all Q,R in Q, for all s in T, for all A in T s , the asser- 
tion 1aEq(X\T s ) = IaEr(X\F s ) for all X in L 00 ^) implies that 
lA(*s,t(Q) = lAU s ,t{R)- 

ii) It satisfies the cocycle condition if for r < s < t in T, for all Q in Q, 

Otr,t{Q) = a r,s(Q) + E Q(<Xs,t(Q)\Fr) 
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